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Abstract 

Some sufficient conditions on the algebraic stability of non-homogeneous regime-switching 
diffusion processes are established. In this work we focus on determining the decay rate of 
a stochastic system which switches randomly between different states, and owns different 
decay rates at various states. In particular, we show that if a finite-state regime-switching 
diffusion process is p-th moment exponentially stable in some states and is p-th moment 
algebraically stable in other states, which are characterized by a common Lyapunov func¬ 
tion, then this process is ultimately exponentially stable regardless of the jumping rate of 
the random switching between these states. Moreover, these results can be applied to the 
stabilization of SDE by feedback control to reduce the observation times. 
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1 Introduction 


The purpose of this work is to study the algebraic stability of regime-switching diffusion pro¬ 
cesses. The stability of a stochastic process is an important property, and has many important 
applications in practice. There are extensive researches on the topic of exponential stability of 
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stochastic processes, for example, m,m,m among others. However, there are a large amount 
of stochastic processes which are stable but subject to a lower decay rate other than exponential 
decay. Consequently, it appears to be necessary to extend the usual results on exponential sta¬ 
bility to algebraic stability, for instance, polynomial or logarithmic stability. To this aim, K. Liu 
and A.Y. Chen in |10] have provided some sufficient conditions for the solutions of stochastic 
differential equations with and without delay. On the other hand, a wide variety of natural and 
engineering systems are inherently in a random environment in the sense that several dynamical 
models are required to describe their behavior when the environment is at different state. For 
example, concerning ecological population modeling, when two or more species live in proximity 
and share the same basic requirements, they usually compete for resources, food or territory. 
But the growth rates and the carrying capacities are often subject to environment noise. For in¬ 
stance, the growth rates of some species in the rainy season are much different from those in the 
dry season. In addition, the environment usually changes randomly. Owing to the advantage of 
providing more realistic models in applications, regime-switching diffusion processes, also known 
as hybrid diffusion processes, have received a fair amount of attention recently. See, for instance, 
[aiTlIiSlIilKinilsniEIlESlISelET] and references therein. However, due to the interaction of 
continuous dynamics and discrete events, the analysis of switching systems is more difficult and 
many new problems have been raised. 

Let us consider the following simple regime-switching process {Xt )t>o G where Xt solves 
dXt = A^^Xtdt with a Markov chain on a finite state space S = {1,... ,N} and a set 

of dx d real matrices. In [3], M. Benaim et al. showed that in the case S = {1, 2}, when Ai and 
A 2 are both Hurwitz (all eigenvalues have strictly negative real part), \Xt \ may converge to 0 or 
00 as t —7> 00 depending on the switching rate as long as an average matrix A = AAi -|- (1 — A)A 2 
has a positive eigenvalue for some A G (0,1). Furthermore, S. Lawley et al. [8] proved that 
the assumption that the average matrix has a positive eigenvalue is not necessary to ensure a 
blowup. These results show that the dynamics of the regime-switching processes can be very 
different from the individual dynamics in each fixed state and the averaged dynamics. 

Precisely, the regime-switching diffusion process considered in this work owns two compo¬ 
nents {Xt,At), where (Xt) satisfies the following stochastic differential equation (SDE) 

dXt = b{t, Xt, At)dt + a{t, Xt, At)dBt, (1.1) 

and (At) is a continuous time Markov chain on a finite state space S = {1,2,..., N} with Q- 
matrix {qij). (Bt) is a Brownian motion in independent of (A^). Throughout this work, we 
assume that (qtj) is irreducible and conservative, which means, in particular, qk = 
for each k G S. Here, the Markov chain (A^) is used to describe the random switching of the 
environment between different states. It can be seen from equation that the behavior of 
{Xt) may be very different when the environment varies in different states, i.e. A^ takes different 


2 


values. The randomness of (A^) can cause essential difference to this system. For instance, there 
are examples (cf. [T7]) to show that even when {Xt) is ergodic in every fixed environment, {Xt) 
itself could be transient when the environment changes randomly between these states. We refer 
the readers to the recent works laisoiiii] and references therein on the recurrent properties of 
regime-switching diffusion processes, where some criteria are provided to justify the recurrent 
property of regime-switching diffusion processes. This work is a continuation of our previous 
work m on the stability of regime-switching diffusion processes. In m, we focused on the time 
homogeneous regime-switching diffusion processes and the exponential stability in probability. 
This work is devoted to studying the algebraic stability of non-homogeneous regime-switching 
diffusion processes. 

Let us illustrate our motivation of this work via the following simple examples. Define the 
processes (Xt), (Yt) and [Zt] by the following SDEs: 


dX^ — — X^dt X^dBi;j Xq — X € M. (f’2) 

dT* = -T^dt + -^=dBt, Yo = yeR. (1.3) 

i + t Y i + r 

dZt = -^dt + Zo = z G M, m > 1. (1.4) 

1 + t Y 1 + t 


Then we have 


lim sup 

t^OO 


logE[X2] 


< —1, lim sup 


logE[Y] 


t^OC log(l -l-t) 


< — 1, lim sup 


logE[Z2] 


t^oo log(l-ht)’' 


< - 1 . 


This means that (Xt) is mean square stable with exponential decay; (Tj) is mean square stable 
with polynomial decay of order 1; (Zt) is mean square stable with polynomial decay of order m. 


Example 1.1 Consider the following regime-switching diffusion process: 

dAii = (^- XtlAt=i - -F (^XtlAt=i + ^yj-^ lAf=2^di?f. (1.5) 

The process (Xt) is mean square stable with exponential decay when the environment A* is at the 
state “1”, and is mean square stable with polynomial decay of order 1 when At is at the state “2”. 
The strong solution of this system exists uniquely (see, e.g. m, or [22] for regime-switching 
diffusions with more general coefficients and state-dependent switching). Some natural and 
important questions are whether the process (Xt) is still mean square stable, and if so, what is 
the decay rate of the process (Xt) when the environment (A*) changes randomly between states 
“1” and “2” according to the Q-matrix (qij). 
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Example 1.2 Consider the following regime-switching diffusion process: 


dX* = - 


Xt 2Xt 


Xt V2Xt 


( 1 . 6 ) 


The process (Xt) is mean square stable with polynomial decay when (A^) takes the fixed value 
“1” or “2”, but of different order. What is the decay rate of (Xt) when (At) changes randomly 
between states “1” and “2”? 


Although the process defined by (jl.bp is very simple, to answer the question posed above 
is rather nontrivial. In fact, direct calculation yields 


dlogXt^ 


3At 
l + t 


dt -\~ 


2VAt 

\/f T ^ 


dBf 


Hence, 


and 


* 3A,, , 2VAI 


Xt =xlexp(- j :j^ds + f 

^ Jo ^ + s Jo 


\/f T 


dB. 


EX| = x^Ee~^o 


(1.7) 


Although the right hand side of (HZl) is simple, it is difficult to calculate or estimate its precise 
decay rate. Formula (HZl) reveals that the decay rate of a regime-switching diffusion process 
depends on the jumping times of the Markov chain (A^) rather than simply on the sojourn time 
of (At) at each hxed state. One can not expect to use the joint distribution of the jumping times 
of the Markov chain (At) to derive some useful estimation. 


According to Theorem 12.71 below, the regime-switching diffusion process (Xt) defined by 
(HSI) is mean square stable with exponential decay regardless of the jumping rate (qij) of (At) 
between states “1” and “2”. This phenomenon of independence of jumping rate (qtj) is inter¬ 
esting from the theoretic viewpoint, and of importance in application to stabilize a switched 
system. This kind of phenomenon also appeared when we discussed the strong ergodicity of 
regime-switching diffusion processes in |18] . An intuitive reason of this fact is that the expo¬ 
nential decay is fast enough that it can not be decelerated to polynomial decay by a process 
with polynomial decay. On the other hand, according to Theorem 12.41 below, the process (Xt) 
satisfying (ll.bp is mean square stable with polynomial decay of order 6, locating in the interval 
(1,2) and depending on the jumping rates of (A*). This reflects the complexity of the stability 
of regime-switching systems. 


In Section 2 we first establish some sufficient conditions for the stability of regime-switching 
diffusion processes in terms of Lyapunov functions. We also provide the corresponding exten¬ 
sion of results in |19] for non-homogeneous regime-switching diffusion processes. Analogous to 
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m, these results can be generalized to study the stability of state-dependent regime-switching 
diffusion processes in an infinite countable state space. We do not present the results in this 
direction as it is not our main purpose of this work. Main results of this work are Theorems 
[231 and \T7l These results reflect the essential characteristics of the regime-switching diffusion 
processes. At last, we apply our results to the stabilization of a SDE by a feedback control which 
can reduce greatly the observation times. 


2 Stability of regime-switching diffusion processes 


In this section we study the algebraic stability of regime-switching diffusion processes. Assume 
that SDE (11.11) admits a unique global solution throughout this work, and refer the reader to 
m or |22) for concrete conditions on coefficients to ensure this assumption holds. Moreover, 
we refer to m Chapter 5], where X. Mao and C. Yuan have discussed many kinds of stability 
for regime-switching diffusion processes, including the asymptotical stability in p-th moment 
(Theorem 5.29), p-th moment exponential stability (Theorem 5.8), etc. 


Definition 2.1 Assume that \{t) > 0 and X{t) t oo as t ^ oo. A stochastic process (Xf) is 
said to be p-th moment stable (p > 0) with decay X{t) of order 7 > 0 i/ there exists a pair of 
positive constants 7 and C{xo) such that E|Yi|^ < C(xq)X{ t)~'^, t >0, or equivalently, 


lim sup 

f—>-oo 


logE|At|P 
log X{t) 


< -7- 


In particular, if X{t) = e*, then (Xt) is ealled p-th moment stable with exponential deeay. If 
lim 4 _>.oo = 0, then (Xt) is called p-th moment stable with algebraic decay. 


Let £/t be the infinitesimal generator of (Xt,At) satisfying SDE (jl.ip . i.e. 

d 


s^tf{t,x,i) = ^{t,x,i) + '^bkit,x,i)^{t,x,i) 


k=l 

1 


+ 9 X] 


kl=l 


dxkdxi 


{t,x,i)-l'^qijf{t,x,j) 

jeS 


for any / € C'^’^(M''' x M'^x S), where (aki) = 


aa 


Lemma 2.2 Let (At, At) be a regime-switching diffusion process satisfying SDE (11.ip 
be a Markov chain on 5 = {1,..., A} with conservative and irreducible Q-matrix {qij). 


and (At) 
Assume 
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that there exists a nonnegative funetion V on M'*'x xS such that x V{t,x,i) is twice 
differentiable, 1V{t,x,i) is differentiable, and 

V{t,x,i)>\xf V (t, X, i) G X X 5; (2.1) 

£/ty{t,x,i) < —'ijj{t)V{t,x,i) V (t, X, i) G M"'" X X 5, (2.2) 


for some function ip G (7(1^+;]^+). Set a{t) = exp (/^ V'(s)ds) for t > 0. Suppose that 
lim 4 _>.oo a{t) = oo, then (Xt) is p-th moment stable with decay rate a{t) of order 1, i.e. 


logE|Xi|P ^ ^ 

iimSUp—-;r^ < —1. 

t^oo loga(t) 


Moreover, it also holds that {Xt) is almost surely asymptotically stable, i.e. 


(2.3) 


lim Xt = 0, a.s. 

t^OO 


Proof. According to Ito’s formula for {Xt,At) (cf. |23] or |16l Theorem 1.45]), one gets 
dV{t, Xt,At) = s^tV{t, Xt, At)dt + dMt, where {Mt) is a martingale. 

Then, for 0 < s < t, 

EV{t,Xt,At) = EV{s,Xs,As) + Ej^rV{r,Xr,Ar)dr 

<EV{s,Xs,As) - f ip{r)EV{r,Xr,Ar)dr. 

J S 

Set u{t) = EV{t, Xt, At) for t > 0. The previous inequality can be rewritten as 

u{t) — u{s) < — / 'ip{r)u{r)dr, 0 < s < t. 

J S 

Dividing both sides by t — s, then letting s f t,we obtain u'{t) < —f!{t)u{f). Applying Gronwall’s 
inequality, we get 

EV{t,Xt,At) = u{t)<EV{0,Xo,Ao)exp(^-J^ i;{r)d 
By virtue of V{t,x,i) > jxj^, it follows that 

E\Xt\P < EV{t,Xt,At) < ED(0,Xo,Ao)exp ( V^(r)d 


Consequently, 


logE\Xt\P ^ ^ 

limSUp—-;r^ < —1, 

t^oo logQ;(t) 
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as 0 ({t) = oo. 


For the sake of asymptotical stability, we shall use the convergence theorem of semi¬ 
martingales (cf. [H Theorem 7, pp. 139]). According to Ito’s formula, it holds 

d(F(t, Xt,At)efo V’Wd-) = (^(t)V(t, Xt, At) + ^tV(t, Xt, At))efo V'Wd-dt + dM(t), 

where (Mt) is a local martingale with M(0) = 0. Due to (|2.2p . we get 

V{t, Xt,At)efo < F(0, Xo,Ao) + M(t), 

which yields that 

lim F(t, Ai,At)ei'o V’Wd" < oo, a.s. (2.4) 

t—>-CO 

Furthermore, as limt^cxD '0(s)ds = oo, it follows from (|2.4p that limt_^oo D(t, X*, At) = 0 a.s. 
By using the control (|2.ip . it is easy to see limt_).ooXt = 0 a.s. ■ 

In [To] . K. Liu and A.Y. Chen established the following criterion on the stability of stochastic 
processes. Consider 

dXt = b{t, Xt)dt + cr{t, Xt)dBt, Xq = xq G (2.5) 

where {Bt) is a Brownian motion in The infinitesimal generator of (Xt) is given by 

2=1 ^J = l 

where (atj) = aa*, and a* denotes the transpose of the matrix {(Jij). Here, the subscript t of Lt 
is used to emphasize that the infinitesimal generator of (Xt) is time-dependent. 

Lemma 2.3 ( [10] ) Let p G C'^’^(M'’' x M'*') and ipi, (p 2 be two continuous nonnegative fune- 
tions. Let X{t) > 0 and X{t) ^ oo as t ^ oo. Assume that for all x G t > 0, there exist 
constant p > 0 and real numbers n, 9 sueh that 


( 1 ) 

( 2 ) 

(3) 


|x|^A(t) < p{t,x), {t,x) G M"*" X 

Ltp{t, x) < pi{t) -I- (p 2 {t)p{t, x), (t, x) G M+ X 


lim sup 

t—too 


log (/o 

log X{t) 


< i', lim sup 

too 


Jq y?2(g)dg 
logA(t) 


< e. 
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Then, whenever 7 := 1 — 0 
X{t) of order 7 , that is, 


v > 0, the solution (Xt) of ()2.5I) is p-th moment stable with decay 


lim sup 

t—>-oo 


logE|X,|P 
log X{t) 


< —7 < 0 . 


We mention that Lemma 12.21 can also be used to investigate the stability of the solutions of 
stochastic differential equations without regime-switching (i.e. iV = 1), which simplifies and 
improves the criterion Lemma 12.31 in some situations. Indeed, if e~■^o't’^(^l’^^(j)i(^t)dt < 00 in 
Lemma 12.31 and the function A is differentiable, we can hnd the functions V and "0 satisfying 
the conditions of Lemma 12.21 In fact, take 


V{t,x) 


X{t) ^p{t,x) + 


I3{t) 

a{t)X{t) ’ 


where a{t) = aoexp ( — Jq (/) 2 (r)dr), oq is a positive constant, and /3(t) = (do — a{s)c/)i{s)ds 
with a constant (3o > a{t)(j)i(t)dt. Then s^tV{t,x) < According to 

Lemma 12.21 it yields that 

logE|Ai|P^^ ^ 

limsup -- - <0-1, 

t^oo logA(t) 

which improves Lemma 12.31 a little bit since 0 — l<z^ + 0 — Iby noting that the constants v, 6 
in the condition (3) of Lemma 12.31 must be nonnegative. 


Lemma 12.21 provides us a sufficient condition for algebraic stability in terms of Lyapunov 
functions. But the coexistence of generators for diffusion processes and Markov chains increases 
greatly the difficulty to construct the desired Lyapunov functions for regime-switching diffusion 
processes. So we need to hnd more concrete conditions to rehect the characterization of regime¬ 
switching processes so as to answer the questions posed in the introduction. 


Now we state our hrst main result of this work, which can be used to answer the questions 
posed in Examples 11.11 and 11.21 

Let us hrst introduce a notation. Let {Xt,At) be dehned by (jl.ll) . Set 


h'’/ = f+EM*. 




k=l 


dxk 


+ 


'y ^ O'ki (l ®) 


k,l=l 


d‘^f 

^ dxkdxi' 


f G 


for every i G 5. 

Theorem 2.4 Let {Xt,At) be a regime-switching diffusion process satisfying (II.ip . where (At) 
is a Markov chain on S = {1,2} with Q-matrix {qki)- Let ip G be a positive decreasing 









function satisfying lim.t-^ 00 'f’it) = 0 and '!/)(s)ds = 00 . Assume that there exist a 

function p G x R'^;]R+), constants p > 0 and 9 G [0,1) such that p{t,x) > \xf’, 

if x) < -e'if{t)p{t, x), 

L\ ’p(t,x) < -il){f)p{t,x), 

for all {t,x) G M+ X Set k = ^ and p{e,K) = Then 

sup «) < 0 . ( 2 . 8 ) 

t^oo Jp Iplsjds 

Moreover, {Xt) is almost surely asymptotically stable, i.e. Xt = 0 a.s. 


Proof. We shall use Lemma 12.21 to prove this theorem, and the key point is to find a suitable 
Lyapunov function V{t,x,i). To this aim, let us first introduce two auxiliary functions /3i(t) 
and / 32 (t). Let /3i(t) G C'^(]R''') be a positive function and /3i(t) > c > 0 for t>0. Set 

Ht) = — — /32{t) = {l-h{t))l3i{t), t>0, 
qi2 

where A > 0 is a constant to be determined later. Set V{t,x,i) = /3i{t)p(t,x) for i = 1 , 2 , 
ft, x) G M"'' X Then 


{t, X, 1) = Pi{t)L'f^p{t, x) + (3[{t)p{t, x) + qi2{P2{t) - Pi{t))p{t, x) 

< (- m )+(||| - 1 ) +r(t, 1 , 1 ) 


= ( - AV'(t) + 


m 


x, 1), {t, x) G X 


Since 


s^tV{t,x,2) = j32{t)L[^^p{t,x) + l32{t)p{t,x) + q2i{f3i{t) - /32{t))p{t,x) 

<(-«*) + B.(|K-l)+||)v'(i,x,2) 

= ( - m + (t,x)€ 

-m + 


lim 

t—)-oo 


-d)ip{t) 


fj{t) 


— —1 + k(A — 9), 


for any e > 0 there exists a constant ro > 0 such that for all t > xq, 


q2i{x-9)ipit) 

gi2-(X-9)m 

f;it) 


< —1 + k(A — 9) + £■ 


(2.9) 


( 2 . 10 ) 


( 2 . 11 ) 
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Moreover, 


/^2(0 ^ (A - p[{t) 

h{t) gi2 - (A - 6»)V^(t) /3i(t)’ 

As V’(i) decreases to 0, there exists a constant ri > 0 such that for all t > ri, A G [0)2], 
qi 2 — (A — 0)'ip{t) > 0, and hence 


1^2W > P'ljt) 
h{t) ~ 

Combining ()2.9I1 . (12.1011 with (I2.1ip . ()2.12p . we get 


( 2 . 12 ) 


s^tV{t, x,i) < (^ max{-A, -1 + k(A - 6) + ^*)’ 


(2.13) 


for t > ro V ri := max{ro,ri}, x G M'^, i = 1,2. Now, by the arbitrariness of A on [0,oo), we 
obtain that 


min maxj—A, —1 + k(A — 0) + e| 
e<x<oo 


= min max{—A, 
e<\<2 

k 6 + 1 — e 

1 + K 


1 + k{X — 9) + e} 

-ris{0,K). 


It is clear that lim£_>.o ?7e(0, k) = r]{6,K). Consequently, there exists A > 0 and corresponding 
function /32(t) and V{t,x,i) such that 


S!/tV {t, x,i) < {- r]s{9, K)'ip{t) + 


1^2 W 

^ 2 (t) 


)V{t,x,i) 


(2.14) 


for t > ro V ri, X G M'^, i = 1, 2. 

We also need to compare the value of /3i{t) and I32(t). As = 1 — h(t) and limt_).oo h(t) = 
limt_).oo(A — 9)xjj{t)/qi2 = 0, there exists a constant r 2 > 0 such that for all t > r2, 


(1 - s)l3i{t) < /32{t) < j3i{t){l + e). 

Invoking p{t,x) > |x|^ for (t,x) G x we get 

l/(t,x,2) >/32(t)|x|^’, l/(t,x, 1) >/3i(t)|x|P > (1+ e)“^/32(t)|x|P, (2.15) 

for t > r2 and x G R*^. 

Set 

C(t) =max|- 0V’(i) + 912- l),-0V'(t) +g 2 i(^^ “ ^ ^ [Oj^o V n], 


10 



















and 

({t) =-T]e{9,K), t>roVri. 
By Ito’s formula and (12.91) . ()2.10p . (|2.14p . we have 


EV{t,Xt,At)<^V{s,Xs,As)+^ I (c(r)V'(r) + ^)F(r,X„A,)dr, 0 < s < t. 


Hence, by Gronwall’s inequality and (|2.15p . we get 

{1 + e)~^/32it)E\Xt\P < V{0,xo,io)exp(^J^ (C(s)V'('S) + 

Invoking that limi_).oo Jq V’(s)ds = oo, 


lim sup j 


\ogE\Xt\P _ f* asMs}ds 


t—^OO 


fo ^(s)ds 


< lim sup 


t —>00 fo ^(s)ds 

C(s)'ip(s)ds - /* 7]e(0, K)'ip(s)ds 


< lim sup 

t—>-oo 


fo ^(s)ds 


(2.16) 


~ f w Vei9, K)ljj(s)ds 

= lim sup . ’ = -VeiO, n). 


t^oo fo ip(s)ds 

Note that the left hand side of (I2.16p is independent of e. So, letting e tend to 0, we obtain 

logE|Xt|P 


lim sup ^ 

t-^-OO fo V’(s)ds 


< -ri{e,K). 


To complete the proof, we only need to use the similar argument of Lemma 12.21 to obtain the 
almost surely asymptotical stability of (Xt), whose details are omitted. ■ 

The questions posed in the introduction can be easily answered by Theorem 12.41 For 
Example 11.11 we take p{t,x) = then we can set = 1 and 0 = 0 in (12.7|) . By (12.8p . it 
yields 

logEX^^ 

iim sup- <-. 

t->-oo t Qi q2 

Similar discussion can yield further the following interesting conclusion. When (Xt) is p-th 
moment stable with decay Ai(t) in the fixed state “1” and p-th moment stable with decay 
A 2 (t) in the fixed state “2” satisfying lim 4 _>.oo A 2 (t)/Ai(f) = 0. Then (Xt) will be ultimately 
p-th moment stable with decay Ai(t). For Example 11.21 we still take p{t,x) = x^, then we set 
V’(^) = and take 0 = 1/m in (12.71) . By (|2.8I) . we get 

qi + q^/m 


log EX/ 
limsup-— 7——— 
4-5.00 log(l + ty' 


< -- 


qi + q 2 

Next, we extend Theorem Ea to deal with the case N > 2. 
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Proposition 2.5 Let {Xt,At) be a regime-switching diffusion process satisfying (jl.ip with S = 
N} and N >2. Let if G be a positive decreasing function satisfying lim if{t) = 0 

t^OO 

and limt_>.oo /q if{s)ds = oo. Assume that there exists a function p G x R"*"), positive 

constants p, ci, ..., cn such that p{t,x) > \xY‘ and 

L^'^">p{t,x) < -Cip{t,x) 


for all {t,x) G R+ x R*^, i £ S. Set 

So = {i£S; Ci = mm{ck-, k £ S}}, Si = S\So. 

Set QjSi = f^''" 3 ^ ‘^0 and qiso = ZljGSo i ^ Si. Assume that both Sq and Si 

are not empty, and qjsi > 0 for every j £ Sq. Set 

maxig5^ qiSo , C2 + nci 

K = -, and p = -, 

minjg5o QjSi 1 + « 


where ci 


mm{ci;i £ 5o}, C 2 = min{cj;i G 5i}. Then 

logElX^r ^ ^ ^ 

iim sup — - < —p < 0. 

£^oo Jo 'f{s)ds 


(2.17) 


Proof. For the sake of simplicity of notation, we may reorder S so that 


Cl < C 2 < ... < Cat. 


There exists some ko < N such that ci = ... = and hence 5o = {1, ..., A:o}- If A:o = then 
the desired result is trivial. So, we only need to consider the case ko < N. 

Let /3i{t) £ C^(R"'“) be a positive function and /3i(t) > c > 0 for all t > 0. Set 


mmje5o qjs^ 

which is well-defined due to our assumption that qjsi > 0 for every j £ Sq. As limi_j.oo 'f{t) = 0, 
(32{t) < /3i{t) for t large enough. Define V{t,x,i) = p{t,x)j3i{f) for i £ Sq, and V{t,x,i) = 
p{t,x)j32{t) for i £ 5i. Then, we obtain that for t large enough, for i £ 5o, 




V (t,X,Z) 


< 




12 













and for i ^ Si, 


£/ty{t,x,i) < 
< 

< 


Ci'lpit) + QiSo 


h{t) 


-1 + 


/ 32 W 




ciV’(t) + (maxg'i^Q 

2€oi 


h{t) 


+ 


V{t,x,i) 




V{t,x,i) 


ciV’(t + (max^i^o)^ - - -77777 + 7-777 

iG5i mmjg 5 qjs^ - (A - ci)V’(t) P2{t)\ 


V{t,x,i). 


Then, applying a similar technique used in the argument of Theorem 12.41 we can obtain the 
desired result (j2.17p . ■ 


Based on the theory of M-matrix, we can provide an interesting result on the p-th moment 
stability with exponential decay fTheorem 12.71 below!. Recall first some notation on M-matrix. 
By B > 0 for a square matrix B, we mean that all elements of B is nonnegative. A square 
matrix A = {aij)nxn is called an M-Matrix if A can be expressed in the form A = si — B with 
some B > 0 and s > Ria(R), where I denotes the n x n identity matrix, and Ria(i3) denotes 
the spectral radius of B. When s > Ria(R), A is called a nonsingular M-matrix. There exist 
many equivalent definitions of the nonsingular M-matrix. We refer the reader to [4] or [19] for 
the characterization of nonsingular M-matrix. 


Lemma 2.6 Let be the same proeess as that of Lemma \2.2[ Assume that there exist a 

funetion p G x ]R'^;]R+), eonstants p > 0 and q G M for every i £ S sueh that 


(i) p(t, x) > |x|^ V (t, x) G M"*" X 
(a) p{t,x) < Ci p{t,x) V (t, x) G M"*-X M^. 


diag(ci,..., Cat) denotes the diagonal matrix generated by the veetor (ci,..., cw) as usual. If the 
matrix — (diag(ci,... , cn ) + Q) is a nonsingular M-matrix, then there exists a constant 7 > 0 
sueh that 

,. logElWr^ 

limsup- < —7 < 0 , 

t—>oo t 

which means that (Xt) is p-th moment stable with exponential decay. 


Proof. As the matrix —(diag(ci,..., cm) -|- Q) is a nonsingular M-matrix, there exists a vector 
^ 3> 0 such that 

/3 = (/3i,.. .,I3n)* = (diag(ci,... ,CAr) + Q)^ < 0, 

i.e. all elements of (3 are strictly less than 0. Set V{t,x,i) = p{t,x)f,i for {t,x,i) G R-'-x R'^ xS. 
By virtue of the conditions (ii), we get 

£/tV{t,x,i) < {diag{ci,... ,cm) + Q)$,{i)p{t,x) 
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^ n \ ^ f^k TT/, 

< maxpfc p[t,x) < - —V (t,x,i). 

kes minfcg 5 

According to Lemma 12.21 we obtain that 

E\Xt\P maxk(zs/3k 

limsup- < —^-— =: —7 < U. 

t—>-oo t iiiiiifcs5 sfc 


Theorem 2.7 Let {Xt,Kt) he a regime-switching diffusion process satisfying (II.Hi . Assume 
that there exist a function p G x a state io G S, constants Ci^ > 0, p > 0 and 

continuous nonnegative functions i/ii for i G 5\{io} such that 

(i) p{t,x)>\x\P V (t, x) G M’*' X 
(a) p{t,x) < —Cigp{t,x) V (t, x) G M+ X 
(Hi) p{t, x) < —'i/’i{t)p{t, x) V {t, x) G R"'" X R'^, i G 5\{zo}. 

Then there exists a constant 7 > 0 such that 

limsup < -7 < 0 . (2.18) 

t —^00 t 

Moreover, the process (Xf) is also almost surely asymptotically stable. 


Proof. Condition (iii) yields that 

p{t, x) < 0, V (t, x) G R^ X R'^, i G 5\{zo}. 


Set ©jQ = (Oki) is an N X N matrix with Oi^i^ = — Cjg and 9ki = 0 for {k, 1) (zq, io). It is known 
that (©jq + Q) associates with a continuous time Markov chain with killing. Therefore, by virtue 
of [51 Theorem 2.27], — (©io + Q) is a nonsingular M-matrix if (©j^ + Q) is nonsingular. Here, 
one should note that the definition of M-matrix in | 6 l Definition 2.1] coincides with the definition 
of nonsingular M-matrix in this work due to the assertion jH N 38 , pp.l37]. As — (©io + Q) is 
an irreducibly diagonally dominant matrix, it follows from the Levy-Desplanques theorem that 
-( 0*0 -|- Q) is nonsingular. Therefore, according to Lemma 12.61 there exists a constant 7 > 0 
such that 


logElAijP 
hm sup- 

t—iOO t 


< -7 < 0 , 


which means that (Xt) is p-th moment exponentially stable. The almost surely asymptotical 
stability of {Xt) follows immediately from Lemma 12.21 ■ 
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Remark 2.8 The condition (ii) of Theorem 12.71 means that the diffusion corresponding to (Xt) 
in the fixed state io is p-th moment exponentially stable. The condition (iii) means that the p-th 
moment of the diffusions corresponding to (Xt) in other fixed states are at least p-th moment 
stable with algebraic decay if lim^^oo/g* V’«('S)ds = oo for i G 5\{io}. According to Theorem 
12.71 (Xi) is p-th moment exponentially stable regardless of the Q-matrix of (A^) when Q is 
irreducible. For Example 1 1.1 1 in the introduction, the diffusion process corresponding to (Xt) in 
the fixed state “ 1 ” is mean square exponentially stable and is stable with polynomial decay in 
the fixed state “2”. Hence, due to Theorem we can also prove that (Xt) is mean square 
exponentially stable. 

In the end, we apply our results on the stability of regime-switching diffusion processes to 
the stabilization problem by a feedback control. Consider the following SDE: 

dAt = b{t, Xt)dt + a{t, Xt)dBt. (2.19) 

If this given SDE is not stable, it is traditional to design a feedback control u{t, Xt) in order for 
the controlled system 

dAt = {b{t, Xt) + u{t, Xt))dt + a{t, Xt)dBt (2.20) 

to become stable. Such a regular feedback control requires the continuous observations of the 
state Xt for all t > 0. This is of course expensive. To be costless and more realistic, X. Mao and 
his collaborators in |13l [T5] investigated the stabilization of a given hybrid SDE by discrete-time 
feedback control. Based on their method, one can design a feedback control ri(t, A([t/r]r)) 
based on the discrete-time observations of Xt at times r, 2 r,... so that the controlled system 

dAt = {b{t, Xt) + u{t, X{[t/T]T)))dt + cT(t, Xt)dBt (2.21) 

becomes stable. The results in [laiis] require the step size r to be small enough to guarantee 
the discrete-time controlled system being stable via studying the stability of the corresponding 
continuous time controlled system. Therefore, this method eliminates the observation times of 
Xt, but one still needs a large number of observations as r is small. 

Applying our results on the stability of regime-switching diffusion processes, we can design 
a new approach to stabilize the SDE (12.191) . We first realize a continuous time Markov chain 
(Ai) on the state space S = {1,2} independent of the Brownian motion in SDE (12.191) . then 
construct a feedback control u{t, Xt, At) such that u{t,x, 1 ) = 0 and the controlled system 

dAt = {h{t, Xt) + u{t, Xt, At))dt + a{t, Xt)dBt (2.22) 

to be stable. For instance, u{t, Xt, At) is designed so that we can use the criteria established in 
Theorems 12.61 and 12.71 to check the stability of SDE (j2.22[) . If the Markov chain (A^) starts at 


15 








Aq = 1 , then it will stay at “1” for a random time Ti, which is exponentially distributed with 
rate parameter qi, i.e. P(Ti > t) = After that the process (A*) jumps to “2” and sojourns 

at “2” for a random time T 2 , which is exponentially distributed with parameter q 2 . Then (A^) 
jumps back to “1” and so on. Let a{t) denote the time spent by (A^) at the state “1” during 
the time interval [0,t]. It is known that (cf. for example, |24j l 


lim 

t—>-oo 


IE[a(t)] 

t 


g2 

+ Q'2 ’ 


(2.23) 


For example, when qi = q 2 , the equality (|2.23l) implies that the process (A^) spends half of time 
to stay at the state “1” in average for large t. Since we do not need to observe Xt when the 
Markov chain (A^) is at state “1”, this method can greatly reduce the number of observations of 
Xt in average. Moreover, one can combine this kind of feedback control with X. Mao’s results 
in m to further reduce the number of observations. This is a kind of feedback control putting 
in a random environment. 
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